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(54) Face image recognition apparatus 

(57) A ten-key section (1 04) which is used to Input 
identification information such as a password or ID 
number is disposed on the lower right side of or directly 



below a camera (101) so that the hand of a to-be-rec- 
ognized person (100) who Inputs Identification informa- 
tion such as a password or ID number will not obstruct 
inputting of a face Image 
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Description 

[0001] This invention relates to a face image recogni- 
tion apparatus which recognizes the face image of a per- 
son for security management or the like and a passage 
control apparatus which controls the passage of a pas- 
ser by use of the face image recognition apparatus. 
[0002] The face image recognition apparatus is used 
to recognize the face image of a person for security 
management or the tike. An example of the conventional 
face image recognition apparatus is disclosed in Jpn. 
Pat. Appln. KOKAI Publication No. 2001-5836, for ex- 
ample. In the face image recognition apparatus dis- 
closed in Jpn. Pat. Appln. KOKAI Publication No. 
2001 -5836, feature information items of the face images 
of registrants are previously registered in correspond- 
ence to identification information items in a dictionary. 
A to-be-recognized person who uses the face image 
recognition apparatus inputs his own identification infor- 
mation (such as an ID number). Then, the face image 
recognition apparatus specifies feature information cor- 
responding to the identification information input by the 
to-be-recognized person in the dictionary and inputs the 
face image of the to-be-recognized person. After spec- 
ifying the feature information corresponding to the iden- 
tification information and inputting the face image of the 
to-be-recognized person, the face image recognition 
apparatus collates feature information extracted from 
the input face image with the feature information spec- 
ified in the dictionary based on the identification infor- 
mation and performs the recognition process for the 
face image of the to-be-recognized person. 
[0003] Thus, in the conventional face image recogni- 
tion apparatus, a method for permitting the to-be-recog- 
nized person to input his own identification information 
and specify registration information (feature informa- 
tion) registered in the dictionary is used. For example, 
in the conventional face image recognition apparatus 
disclosed in Jpn. Pat. Appln. KOKAI Publication No. 
2001 -5836, identification information of the to-be-recog- 
nized person is input by use of a key input section such 
as a keyboard or card reader. Further, in the conven- 
tional face image recognition apparatus, registration in- 
formation is specified in the dictionary and the face im- 
age of the to-be-recognized person is input by use of 
the image input section after input of identification infor- 
mation by the to-be-recognized person is completed. 
[0004] However, in the conventional face image rec- 
ognition apparatus, the hand or the like of the to-be-rec- 
ognized person who inputs identification information 
may obstruct inputting of the face image in some cases 
when the image input section inputs the face image. Ac- 
cordingly, an object of this invention is to provide a face 
image recognition apparatus and passage control ap- 
paratus which permits a face image to be stably input 
without causing the hand or the like of the to-be-recog- 
nized person to obstruct inputting of the face image by 
the image input section when the to-be-recognized per- 



son inputs identification information by use of the key 
input section. 

[0005] Further, in the conventional face image recog- 
nition apparatus, a psychological oppression sensation 

5 is given to the to-be-recognized person in some cases 
since he becomes aware of the presence of the image 
input section. Accordingly, an object of this invention is 
to provide a face image recognition apparatus and pas- 
sage control apparatus which permits a face image of 

10 the to-be-recognized person to be input without causing 
the to-be-recognized person to become aware of the 
presence of the image input section. 
[0006] Further, in the conventional face image recog- 
nition apparatus, since registration information is spec- 
ks jfied in the dictionary after inputting of identification in- 
formation by the to-be-recognized person is completely 
ended, rt will take a long time until the recognition result 
is output. Accordingly, an object of this invention is to 
provide a face image recognition apparatus, passage 

20 control apparatus, face image recognition method and 
passage control method which can reduce the process- 
ing time from the start of input of identification informa- 
tion by the to-be-recognized person until the recognition 
result is output. 

25 [0007] A face image recognition apparatus of this in- 
vention which recognizes a person based on a face im- 
age, comprises an image input section which inputs a 
face image of a to-be -recognized person, an illuminating 
section which applies light toward at least a face of the 

30 to-be-recognized person, a feature amount extracting 
section which extracts a feature amount of the face of 
the to-be- recognized person based on the face image 
input by the image input section, a feature amount reg- 
istration section in which a reference feature amount is 

36 previously registered in correspondence to identification 
information of the to-be-recognized person, a key input 
section which is disposed below the image input section 
as viewed from the to-be-recognized person and per- 
mits the to-be-recognized person to input his own iden- 

40 tification information, and a recognition section which 
recognizes the face image of the to-be-recognized per- 
son by collating a feature amount extracted by the fea- 
ture amount extracting section with a reference feature 
amount corresponding to identification information and 

45 acquired from the feature amount registration section 
based on the identification information input by the key 
input section. 

[0008] A face image recognition apparatus of this in- 
vention which recognizes a person based on a face im- 

50 age, comprises a key input section which permits a to- 
be-recognized person to input his own identification in- 
formation, an image input section which is disposed in- 
side the key input section and inputs a face image of the 
to-be-recognized person, an illuminating section which 

55 applies light toward at least a face of the to-be-recog- 
nized person, a feature amount extracting section which 
extracts a feature amount of the face of the to-be-rec- 
ognized person based on the face image input by the 
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image input section, a feature amount registration sec- 
tion in which a reference feature amount is previously 
registered in correspondence to identification informa- 
tion of the to-be-recognized person, and a recognition 
section which recognizes the face image of the to-be- 
recognized person by collating a feature amount ex- 
tracted by the feature amount extracting section with a 
reference feature amount corresponding to identifica- 
tion information and acquired from the feature amount 
registration section based on the identification informa- 
tion input by the key input section. 
[0009] A face image recognition apparatus of this in- 
vention which recognizes a person based on a face im- 
age, comprises an image Input section which Inputs a 
face image of a to-be-recognized person, a feature 
amount extracting section which extracts a feature 
amount of the face of the to-be-recognized person 
based on the face image input by the image input sec- 
tion, a feature amount registration section In which a ref- 
erence feature amount corresponding to identification 
information of the to -be- recognized person is previously 
registered as registration information, a key input sec- 
tion which permits the to-be-recognized person to input 
his own identification information configured by charac- 
ters of plural digits, and a recognition section which rec- 
ognizes the face image of the to-be-recognized person 
by collating the face feature amount extracted by the 
feature amount extracting section with a reference fea- 
ture amount acquired as registration information of a 
number reduced and selected from the feature amount 
registration section based on identification information 
o.f the number of digits Input by the key input section 
each time the identification information is input by one 
digit by the key input section. 

[0010] A passage control apparatus of this Invention 
which recognizes a face image of a passer and controls 
the passage of the passer, comprises an image input 
section which inputs a face image of a passer, an illu- 
minating section which applies light toward at least a 
face of the passer, a feature amount extracting section 
which extracts a face feature amount of the passer 
based on the face image input by the image input sec- 
tion, a feature amount registration section in which a ref- 
erence feature amount is previously registered in corre- 
spondence to Identification information of the passer, a 
key input section which is disposed below the image in- 
put section as viewed from the passer and permits the 
passer to input his own identification information, a rec- 
ognition section which recognizes the face Image of the 
passer by collating a feature amount extracted by the 
feature amount extracting section with a reference fea- 
ture amount corresponding to identification information 
input by the key input section and acquired from the fea- 
ture amount registration section based on the identifica- 
tion information, and a passage control section which 
controls the passage of the passer based on the recog- 
nition result of the recognition section. 
[0011] A passage control apparatus of this Invention 



which recognizes a face image of a passer and controls 
the passage of the passer, comprises a key Input section 
which permits the passer to input his own identification 
information, an image input section which is disposed 

5 inside the key input section and inputs a face image of 
a passer, an illuminating section which applies light to- 
ward at least a face of the passer, a feature amount ex- 
tracting section which extracts a face feature amount of 
the passer based on the face Image input by the image 

^0 Input section, a feature amount registration section In 
which a reference feature amount is previously regis- 
tered in correspondence to identification information of 
the passer, a recognition section which recognizes the 
face image of the passer by collating a feature amount 
extracted by the feature amount extracting section with 
a reference feature amount corresponding to identifica- 
tion information input by the key input section and ac- 
quired from the feature amount registration section 
based on the Identification Information, and a passage 

20 control section which controls the passage of the passer 
based on the recognition result of the recognition sec- 
tion. 

[0012] A passage control apparatus of this Invention 
which recognizes a face image of a passer and controls 

25 the passage of the passer, comprises an image input 
section which inputs a face image of a passer, a feature 
amount extracting section which extracts a face feature 
amount of the passer based on the face image Input by 
the image input section, a feature amount registration 

30 section in which reference feature amounts correspond- 
ing to identification information items of registrants are 
previously registered as registration information, a key 
input section which permits the passer to input his own 
identification information configured by characters of 

35 plural digits, and a recognition section which recognizes 
the face Image of the passer by collating the face feature 
amount extracted by the feature amount extracting sec- 
tion with a reference feature amount acquired as regis- 
tration information of a number reduced and selected 

40 from the feature amount registration section based on 
identification Information of the number of digits input by 
the key input section each time the identification infor- 
mation Is input by one digit by the key input section. 
[0013] A passage control apparatus of this Invention 

45 which recognizes a face Image of a visitor and controls 
the open/close state of an entrance/exit door of a visiting 
destination based on the recognition result, comprises 
an image input section which inputs at least a face im- 
age of a visitor, an illuminating section which applies 

50 light toward at least a face of the visitor, a feature amount 
extracting section which extracts a face feature amount 
of the visitor based on the face image input by the image 
input section, a feature amount registration section in 
which a reference feature amount is previously regis- 

55 tered in correspondence to identification information of 
the visiting destination, a key input section which is dis- 
posed below the image input section as viewed from the 
visitor and permits the visitor to input the identification 
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information of tlie visiting destination, a recognition sec- 
tion which recognizes the face image of the visitor by 
collating a feature amount extracted by the feature 
amount extracting section with a reference feature 
amount corresponding to identification information input 
by the key input section and acquired from the feature 
amount registration section based on the identification 
information, and a door control section which controls 
the open/close state of the entrance/exit door of the vis- 
iting destination based on the recognition result of the 
recognition section. 

[001 4] A face image recognition method of this inven- 
tion used in a face image recognition apparatus includ- 
ing a feature amount registration section in which iden- 
tification information configured by characters of plural 
digits assigned to at least one registrant and a reference 
feature amount of at least one registrant corresponding 
to the identification information are previously registered 
as registration information, comprises inputting a face 
image of a to-be-recogntzed person, extracting a face 
feature amount of the to-be-recognized person based 
on the input face Image, permitting the to-be- recognized 
person to input his own Identification information config- 
ured by characters of plural digits for each digit by use 
of an operation key, and recognizing the face image of 
the to-be-recognized person by collating the face fea- 
ture amount extracted based on the input face image 
with a reference feature amount as registration informa- 
tion of a number reduced and selected from the feature 
amount registration section based on identification in- 
formation of the number of digits input each time the 
identification information is input by one digit by use of 
the operation key. 

[0015] A passage control method of this invention 
used in a passage control apparatus including a feature 
amount registration section in which identification infor- 
mation configured by characters of plural digits as- 
signed to at least one person who is permitted to pass 
through and a reference feature amount of at least one 
person corresponding to the identification information 
are previously registered as registration information, 
comprises inputting a face image of a passer, extracting 
a face feature amount of the passer based on the input 
face image, permitting the passer to input his own iden- 
tification information configured by characters of plural 
digits for each digit by use of an operation key, recog- 
nizing the face image of the passer by collating the face 
feature amount extracted based on the input face image 
with a reference feature amount as registration informa- 
tion of a number reduced and selected from the feature 
amount registration section based on identification in- 
formation of the number of digits input by use of the op- 
eration key each time the identification information is in- 
put by one digit by use of the operation key, and con- 
trolling the passage of the passer based on the recog- 
nition result obtained by the recognizing the face image 
of the passer. 

[0016] This summary of the invention does not nec- 



essarily describe all necessary features so that the in- 
vention may also be a sub-combination of these de- 
scribed features. 

[0017] The invention can be more fully understood 
5 from the following detailed description when taken in 
conjunction with the accompanying drawings, in which: 

FIG. 1 is a configuration diagram schematically 
showing the configuration of a face image recogni- 
10 tion apparatus according to a first embodiment of 
this invention; 

FIG. 2 is a side view showing the relation between 
a first illuminating section and a camera; 
FIG. 3 is a top view showing the relation between 
15 the first illuminating section and the camera; 

FIG. 4 is a view showing an example of a face image 
to be photographed by use of the first illuminating 
section; 

FIG. 5 is a side view showing the relation between 
20 a second illuminating section and the camera; 

FIG. 6 is a block diagram schematically showing the 
configuration of a feature amount extracting sec- 
tion; 

FIG. 7 is a flowchart for illustrating the recognition 
25 process of a recognition section; 

FIG. 8 is a front view showing an example of instal- 
lation of a ten-key section; 

FIG. 9 is a front view showing an example of instal- 
lation of a ten-key section; 

30 FIG. 10 is a front view showing an example of in- 
stallation of a ten-key section; 
FIG, 11 is a front view showing an example of in- 
stallation of a ten-key section; 
FIG. 12 is a front view showing an example of in- 

35 staNation of a unit having a display section; 

FtG. 13 is a front view showing an example of in- 
stallation of a unit having a display section; 
FIG. 14 is a front view showing an example of in- 
stallation of a unit having a display section; 

40 FIG. 15 is a front view showing an example of in- 
stallation of a unit having a display section; 
FIG. 16 is a flowchart for illustrating the recognition 
process of a recognition section according to the 
first embodiment; 

45 FIG. 1 7 is a flowchart for illustrating the recognition 
process of the recognition section according to the 
first embodiment; 

FIG. 18 is a flowchart for illustrating the recognition 
process of the recognition section according to the 

50 first embodiment; 

FIG. 19 is a configuration diagram schematically 
showing the configuration of a face image recogni- 
tion apparatus according to a second embodiment 
of this invention; 

55 FIG. 20 is a plan view showing the Installation state 
of a camera with respect to a ten-key section; 
FIG. 21 is a flowchart for illustrating the recognition 
process of a recognition section according to a third 
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embodiment; 

FIG. 22 is a flowchart for illustrating the recognition 
process of the recognition section according to the 
third embodiment; 

FIG. 23 Is a configuration diagram schematically 5 
showing the configuration of a passage control ap- 
paratus according to a fourth embodiment of this in- 
vention; 

FIG. 24 is a configuration view showing an example 

of the configuration of a ten-key section; io 

FIG. 25 is a configuration view showing an example 

of the configuration of a ten-key section; 

FIG. 26 is a configuration view showing an example 

of the configuration of a ten-key section; 

FIG. 27 Is a configuration view showing an example is 

of the configuration of a ten-key section; 

FIG. 28 is a flowchart for illustrating the recognition 

process of a recognition section according to the 

fourth embodiment; 

FIG. 29 is a configuration view schematically show- 20 
ing the configuration of a physical key; and 
FIG. 30 is a flowchart for illustrating the recognition 
process of the recognition section according to the 
fourth embodiment. 

25 

[0018] There will now be described embodiments of 
this invention with reference to the accompanying draw- 
ings. 

[001 9] First, a first embodiment of this invention is ex- 
plained. 30 
[0020] FIG. 1 schematically shows the configuration 
of a face image recognition apparatus according to the 
first embodiment. The face image recognition apparatus 
includes a camera 101, first illuminating section 102, 
second illuminating section 103, ten-key section 104 35 
and processing section 105. 

[0021] The camera 101 is used to photograph and In- 
put a face image (which is an image including at least 
the face) of a to-be-recognized person 100. For exam- 
ple, the camera 101 Is configured by a television camera 
using an imaging device such as a CCD sensor. 
[0022] The first illuminating section 102 applies light 
toward at least the face of the to-be- recognized person 
100 with constant illuminance in an oblique direction 
from the upper right side or upper left side of the camera 
101. The second illuminating section 103 applies light 
toward at least the face of the to-be-recognized person 
100 with constant illuminance in an oblique direction 
from below the camera 101 . 

[0023] The ten-key section 104 is operated to input so 
an ID number (or a password) used as identification in- 
formation of the to-be-recognized person 100. The 
processing section 105 processes a face image input 
from the camera 101 and an ID number input from the 
ten-key section 104 and performs the recognition proc- ss 
ess or the like for the face image. 
[0024] Next, the first illuminating section 1 02 and sec- 
ond illuminating section 103 are explained in detail. 



[0025] The first illuminating section 102 is an illumi- 
nating unit such as a fluorescent light which applies light 
toward at least the face of the to-be-recognized person 

100 with constant illuminance in an oblique direction 
from the upper right side or upper left side of the camera 
101. As shown in FIGS. 2 and 3, the first illuminating 
section 102 is disposed to make an angle of 45" be- 
tween the optical axis of the first illuminating section 1 02 
and the optical axis of the camera 101 . The first illumi- 
nating section 1 02 may be disposed in such a condition 
that the angle between the optical axis of the first illumi- 
nating section 102 and the optical axis of the camera 

101 is 30° or less, for example. 

[0026] That \s, the first illuminating section 1 02 forms 
the shadows of parts of the face (such as a nose and 
eyes) on the half portion of the face (hatched portion 
100a of FIG. 4) by applying direct light toward the face 
of the to-be-recognized person 100 as shown in FIG. 4. 
In this case, diffusion light or indirect light can be used 
instead of the direct light as light from the first illuminat- 
ing section 102 and the same effect can be attained if 
the shadow can be formed on the half portion of the face. 
[0027] The second illuminating section 103 Is an illu- 
minating unit such as a fluorescent light which applies 
light toward at least the face of the to- be- recognized per- 
son 1 00 With constant illuminance in an oblique direction 
from below the camera 101. As shown in FIG. 5. the 
second illuminating section 103 is disposed to make an 
angle of 45° between the optical axis of the second illu- 
minating section 103 and the optical axis of the camera 
101. The second illuminating section 103 may be dis- 
posed in such a condition that the angle Is set in a range 
of 30° and 60° (including both limits), for example. It is 
sufficient only if direct light from the second illuminating 
section 103 is applied toward the face of the to-be-rec- 
ognized person 100. In this case, diffusion light or indi- 
rect light can be used instead of the direct light as light 
from the second illuminating section 103 if "it is the same 
type as light from the first illuminating section 102. 
[0028] Next, the relation between the first illuminating 
section 102 and the second Illuminating section 103 Is 
explained. Illuminance 1 A of light from the first illuminat- 
ing section 1 02 and illuminance 2A of light from the sec- 
ond illuminating section 103 satisfy the relation of 1 A > 
2A. 

[0029] A shadow is formed on the half portion of the 
face image of the to-be-photographed person 100 by 
use of the two illuminating sections (first illuminating 
section 102, second illuminating section 103). That Is, 
the illuminance 1 A of light from the first illuminating sec- 
tion 102 is higher than the illuminance 2A of light from 
the second illuminating section 103 according to the 
above relation. Therefore, the shadow on the half por- 
tion of the face image of the to-be-recognized person 
100 formed by light from the first illuminating section 102 
appears more strongly than the shadow formed by light 
from the second illuminating section 103. The shadow 
on the half portion of the face image of the to-be-recog- 
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nized person 1 GO clearly and satisfactorily expresses in- 
formation of unevenness on the face of each person 
(face feature information of each person). Thus, by em- 
phasizing the shadow of the half portion of the face im- 
age, the face feature amount extracted from the face 
image emphasizes the difference between individuals. 
As a result, the recognition rate of the face image is en- 
hanced. 

[0030] Light from the second iiluminating section 1 03 
suppresses light from the first illuminating section 102 
from forming an excessively strong shadow on the face 
of the to-be-recognized person 100 based on the above 
relation. That is, if only the first illuminating section 102 
is used, the way of forming a shadow on the face is dif- 
ferent according to a variation in the distance between 
the to-be-recognized person 100 and the camera 101 
at the recognition time and at the registration time. How- 
ever, a lowering in the recognition rate due to a subtle 
difference in formation of the shadow can be sup- 
pressed by using the second Illuminating section 103. 
[0031] In a case where the position of the face of a 
person and the position of the camera 1 01 are kept sub- 
stantially unchanged at the recognition time and at the 
registration time, the second illuminating section 103 
can be omitted. This is because the shape of the shadow 
formed on the face image is substantially the same if the 
position of the face of a person and the position of the 
camera 101 are kept substantially unchanged at the rec- 
ognition time and at the registration time. For example, 
if the standing position of a person is fixed or the guid- 
ance function which displays the size of the face image 
at the registration time by use of a circular mark or the 
like is used, the distance between and a horizontal de- 
viation in the position of the face of a person and the 
position of the camera 101 at the recognition time are 
kept substantially the same as the distance between 
and a horizontal deviation in the position of the face of 
a person and the position of the camera 101 at the reg- 
istration time. Therefore, the second illuminating section 
103 can be omitted. 

[0032] Assume now that the total value of the illumi- 
nance 1 A of light from the first illuminating section 102 
and the illuminance 2A of light from the second illumi- 
nating section 103 which illuminate the face of the to- 
be-recognized person 100 is B lux (Ix). Further, assume 
that the illuminance by external light or the like which is 
applied to the face of the to-be-recognized person 100 
is C lux (Ix). In this case, if the relation of 1 A + 2A - B > 
C is established, the influence by external light can be 
suppressed. For example, if it is required to suppress 
the influence by a ceiling light such as a fluorescent light 
which lies on the upper rear side of the to-be- recogn ized 
person 100, the illuminance of light from the first illumi- 
nating section 102 and the illuminance of light from the 
second illuminating section 103 may be so set as to es- 
tablish the above relation. Further, the total illuminance 
B (Ix) of the illuminance 1 A of light from the first illumi- 
nating section 102 and the illuminance 2A of light from 



the second illuminating section 1 03 is defined in a range 
so as to prevent the input face Image from being set into 
the saturated state. 

[0033] It is assumed that the first illuminating section 

5 1 02 and second illuminating section 103 are always set 
in the ON state, but It is also possible to turn ON the first 
Illuminating section 102 and second illuminating section 
103 only when the to- be -recognized person 100 comes 
near the present apparatus. In this case, for example, 

10 this can be attained by additionally providing a human 
sensor such as an infrared sensor on the present appa- 
ratus and causing the human sensor to sense the to-be- 
recognized person 1 00 who comes near the present ap- 
paratus and turn ON the first iiluminating section 102 

15 and second illuminating section 103. Further, it is pos- 
sible to sense a to-be-recognized person 100 who 
comes near the present apparatus by detecting a mov- 
ing body based on an image input from the camera 101 . 
[0034] Next, the processing section 105 is explained. 

20 [0035] The processing section 1 05 can be configured 
by a computer, for example. The processing section 105 
is operated based on a control program to realize vari- 
ous functions. The control program is stored in a storage 
medium such as a hard disk, CD-ROM, MD or FD. 

25 [0036] In the following explanation, various informa- 
tion items including image input data, extracted feature 
amount, partial space, inherent vector configuring a par- 
tial space, correlation matrix, status Information such as 
time, date and location of registration, individual infor- 

30 mation such as a password, ID number are used. Fur- 
ther, in the following explanation, data to be recognized 
contains a partial space or inherent vector configuring 
a partial space. In addition, in the following explanation, 
registration information contains image input data, ex- 

35 tracted feature amount, partial space, inherent vector 
configuring a partial space, correlation matrix, status in- 
formation and individual information. Therefore, the rec- 
ognition data is contained in the registration information. 
[0037] An example of the concrete configuration of 

40 the processing section 105 is explained below in detail 
with reference to FIG. 1 . The processing section 105 in- 
cludes an image input section 106 used as image input 
means, a feature amount extracting section 107 used 
as feature amount extracting means, a recognition sec- 

45 tion 108 used as recognition means, a registration infor- 
mation holding section (dictionary) 109 used as feature 
amount registration means, a registration information 
adding section 110 used as feature amount adding 
means, and a number input processing section 111. 

50 [0038] The image input section 1 06 is supplied with a 
face image from the camera 101 , A/D-con verts the input 
face image into a digital form and then supplies the dig- 
ital face image to the feature amount extracting section 
107. 

55 [0039] In the registration information holding section 
109, registration information items such as reference 
feature amounts corresponding to ID numbers of to-be- 
recognized persons 100 are previously registered 
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(stored). 

[b040] When the recognition rate of the recognition 
section 1 08 becomes lower than a preset value, the reg- 
istration information adding section 1 1 0 additionally reg- 
isters registration information such as a reference fea- 
ture amount (a new reference feature amount) which is 
obtained from the face image input at this time into the 
registration information holding section 109. 
[0041] The number input processing section 1 1 1 proc- 
esses an ID number input by use of the ten-key section 
104. 

[0042] The feature amount extracting section 1 07 ex- 
tracts a feature amount such as partial space informa- 
tion or tight and shade Information by use of the face 
image of the to-be-recognized person 1 00 supplied from 
the image input section 106. For example, as shown in 
FIG. 6, the feature amount extracting section 107 in- 
cludes a face region detecting section 107A, face part 
detecting section 107B and feature amount creating 
section 107C. The feature amount extracting section 
107 is explained below in detail with reference to FIG. 6. 
[0043] The face region detecting section 107A de- 
tects a face region based on a face image Input from the 
camera 101 . For example, with the face region detecting 
section 107A. a previously prepared template Is moved 
in the image to derive correlation values and a location 
in which the largest correlation value is obtained is de- 
tected as a face region. The face region detecting sec- 
tion 107A can be used to detect a face region by use of 
a face region extracting method which utilizes a partial 
space method or inherent space method. 
[0044] The face part detecting section 107B detects 
the positions of the nose and eyes from parts of the de- 
tected face region. For example, the face part detecting 
section 107B detects the positions of the face parts 
(parts of the face such as the nose and eyes) based on 
face feature points by use of a method disclosed in a 
document ("Face Feature Point Extraction by Combina- 
tion of Shape Extraction and Pattern Collation" by Ka- 
zuhiro Fukui, Osamu Yamaguchi, Study Papers of Insti- 
tute of Electronic Information and Communication Engi- 
neers (D), vol. J80-D-II, No. 8. pp. 2170 to 2177 (1997)). 
[0045] The feature amount creating section 1 07C ex- 
tracts a face region of a preset size and shape based 
on the positions of the face parts detected by the face 
part detecting section 1078 and uses light and shade 
information thereof as a feature amount. In this case, for 
example, the feature amount creating section 107C us- 
es the light and shade value of a region of m pixels x n 
pixels as a feature amount and uses the feature amount 
as a feature vector of m x n dimension. 
[0046] Further, in a case where the mutual partial 
space method is used in the recognition section 1 08, the 
feature amount creating section 107C creates the fea- 
ture amount by the following procedure. For example, 
the mutual partial space method is a known recognition 
method described in a document ("Pattern Matching 
Method using Local Configuration" by Kenichi Maeda, 
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Sadalchi Watanabe, Study Papers of Institute of Elec- 
tronic Information and Communication Engineers (D), 
vol. J68-D, No. 3, pp. 345 to 352 (1985)). 
[0047] When the mutual partial space method is used 

5 as the recognition method, the feature amount creating 
section 1 07C first derives a feature amount as a feature 
vector of m X n dimension. Then, the feature amount 
creating section 107C derives a correlation matrix (or 
covariance matrix) of the thus calculated feature vector 

10 and derives a normal orthogonal vector by use of K-L 
expansion with respect to the correlation matrix. Thus, 
the feature amount creating section 107C calculates a 
partial space. The partial space is expressed by select- 
ing k inherent vectors corresponding to inherent values 

15 In an order from the largest inherent value and using the 
set of inherent vectors. 

[0048] In the present embodiment, the feature 
amount creating section 107C derives a correlation ma- 
trix Cd from the feature vector and derives a matrix <t> of 
20 the Inherent vectors by diagonalizing the correlation ma- 
trix as indicated by the following equation. 

Cd = <t> d A d <t> dT 

25 

[0049] For example, the feature amount creating sec- 
tion 107C derives the correlation matrix of the feature 
vector based on time series face image data obtained 
from the input image and derives a normal orthogonal 

30 vector by use of the K-L expansion. Thus, the feature 
amount creating section 107C calculates the partial 
space. The partial space is registered into the registra- 
tion information holding section 1 09 as a recognition dic- 
tionary which Is used to identify a person. For example, 

35 the partial space derived from the face image of a to-be- 
recognized person is previously registered in the dic- 
tionary as the feature amount of the to-be-recognized 
person. 

[0050] Further, as will be described later, the partial 
40 space itself may be used as input data which is used to 
perform the recognition process. Therefore, the result 
of calculation of the partial space is supplied to the rec- 
ognition section 108 and registration information holding 
section 109. 

45 [0051] The recognition section 108 collates (com- 
pares) registration information (containing partial spac- 
es) registered in the registration information holding 
section 109 with a feature amount (light and shade in- 
formation or partial space information) obtained in the 

50 feature amount extracting section 1 07. Then, the recog- 
nition section 108 performs a recognition process to de- 
termine who a to-be-recognized person 100 photo- 
graphed by the camera 101 is or performs an identifica- 
tion process to determine whether the to-be-recognized 

55 person 1 00 photographed by the camera 101 is a spec- 
ified person or not. In order to permit the recognition sec- 
tion 108 to recognize a person, it is only required to de- 
termine one of the features of the persons registered in 
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the dictionary which is most similar to the feature 
amount extracted from the face image photographed by 
the camera 101. Therefore, when a person is recog- 
nized, the recognition section 108 calculates the simi- 
larities between the feature amount extracted from the 
face image photographed by the camera 101 and all of 
the feature amounts registered in the dictionary and de- 
termines a person with the feature amount which gives 
the largest similarity as the recognition result. 
[0052] Further, when a person is identified based on 
the face image by specifying the person by use of indi- 
vidual information of a card, password, ID number or 
key, the recognition section 108 calculates the similarity 
between the feature amount registered in the dictionary 
corresponding to the individual information and the fea- 
ture amount extracted from the face image photo- 
graphed by the camera 101. Further, the recognition 
section 108 compares the calculated similarity with a 
preset threshold value and recognizes (identifies) that 
the person is a corresponding person if the calculated 
similarity exceeds the preset threshold value. 
[0053] When the identification process of the person 
is performed as described above, it is necessary to use 
means for inputting individual information such as a 
card, password, ID number, key or the like. For example, 
as the card, a recording medium such as an IC card, ID 
card or radio cad on which individual information is re- 
corded can be used. In this case, a card reader to read 
out individual information which can cope with the re- 
cording medium is provided on the present apparatus. 
Further, if a password or ID number is used as individual 
information, key input means for permitting the user to 
input the individual information is provided on the 
present apparatus. For example, when the password or 
ID number is used as individual information, key input 
means such as the ten-key section 104 and number in- 
put processing section 1 1 1 as will be described later may 
be used. 

[0054] Further, in the recognition section 108, a rec- 
ognition method such as a partial space method, multi- 
ple similarity method or the like is used by use of infor- 
mation of the feature amount extracting section 107. 
[0055] Now, a recognition method based on the mu- 
tual partial space method is explained. In this case, in 
the mutual partial space method, it is assumed that the 
feature amount as registration Information previously 
registered in the dictionary and the feature amount ex- 
tracted from an image (input data) photographed by the 
camera 101 are each expressed as a partial space. Fur- 
ther, an "angle" made by the two partial spaces is de- 
fined as the similarity. In this case, a partial space as the 
feature amount extracted from the image photographed 
by the camera 101 is defined as an input partial space. 
[0056] First, a correlation matrix Cin is derived with 
respect to an input data string in the same manner as 
described above and an inherent vector <t> in is derived 
by diagonalizing the correlation matrix as indicated by 
the following equation. 



Cin = <l> in A in <t> inT 

[0057] When the inherent vector <t> in is derived, the 

5 similarity is calculated based on an "angle" made be- 
tween a partial space expressed by the inherent vector 
O in derived from the input data and a partial space ex- 
pressed by an inherent vector <t> d. Thus, the partial 
space similarity (0.0 to 1 .0) between the partial spaces 

10 expressed by the inherent vectors <t> in and <l> d becomes 
the similarity used as a recognition result. 
[0058] The recognition section 108 is operated as 
shown in the flowchart of FIG. 7. First, the operation of 
the recognition section 108 is different depending on 

15 whether it performs the recognition process or the iden- 
tification process (step ST1 ). If the identification process 
is performed, an object ID number of a to-be-recognized 
person is read out by use of the number input processing 
section (step ST2). Then, registration information (par- 

20 tial space) corresponding to the object ID number is read 
out from the registration information holding section 1 09 
(step ST3). 

[0059] Next, as described above, in order to perform 

the recognition process by use of the partial space meth- 

25 od or the like, the recognition section 1 08 calculates the 
similarity between the partial space of each registration 
information and an input partial space or a partial space 
used as the feature amount extracted from the image 
photographed by the camera 101 by use of the feature 

30 amount extracting section 107 (step ST4). Then, the 
recognition section 108 compares the calculated simi- 
larity with a preset threshold value (steps ST5, ST6) and 
determines and outputs the result of identification (step 
ST7). In this case, if the calculated similarity is larger 

35 than the preset threshold value, it is determined that the 
identification can be successfully made and if the calcu- 
lated similarity is not largerthan the preset threshold val- 
ue, it is determined that the identification cannot be suc- 
cessfully made. 

40 [0060] In a case where the recognition process is per- 
formed, the recognition section 108 reads out all of reg- 
istration information Items to be recognized from the 
registration information holding section 109 (step ST8). 
When all of the registration information items to be rec- 

^5 ognized are read out, the recognition section 1 08 calcu- 
lates the similarities between partial spaces of the re- 
spective registration information items and the partial 
space as the feature amount extracted from the image 
photographed by the camera 101 (step ST9). After cal- 

50 culating the similarities with the respective registration 
information items, the recognition section 108 selects 
the maximum one of the calculated similarities (step 
ST10) and outputs data indicating a person correspond- 
ing to the registration information which gives the max- 

55 imum similarity as the recognition result (step ST1 2). 
[0061] Further, it is also possible for the recognition 
section 108 to determine (determine by use of a thresh- 
old value) whether the maximum similarity is larger than 
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a preset threshold value as shown by the step ST1 1 sur- 
rounded by broken lines in FIG. 7. In this case, whether 
the recognition result is correct or not can be checked 
(step ST13). For example, if the maximum similarity is 
smaller than the preset threshold value, the recognition 
section 108 determines that the recognition result does 
not correspond to any one of the to-be-recognized ob- 
jects. 

[0062] In the registration information holding section 
1 09, it is possible to register (or store) image input data, 
extracted feature amounts, status information such as 
time, date and location of registration and the like as 
registration information in addition to the partial spaces 
(or correlation matrices and the like) used to identify a 
to-be-recognized person). 

[0063] In the present embodiment, not only a case 
wherein partial spaces are held, but also a case wherein 
correlation matrices used in the preceding stage to cal- 
culate partial spaces are held is explained. 
[0064] The registration information holding section 
109 holds one registration information for each individ- 
ual information item such as a person or ID number. In 
the registration information, the partial space Is stored 
together with attendant information such as time at 
which the partial space is acquired. 
[0065] Next, the registration information adding sec- 
tion 110 is explained. The registration information add- 
ing section 110 performs a process to additionally reg- 
ister new registration information (reference feature 
amount) into the registration information holding section 

109 when the recognition rate or similarity with respect 
to specified registration information obtained in the rec- 
ognition section 108 becomes lowerthan a preset value. 
For example, the registration information adding section 

110 monitors the recognition result obtained by the rec- 
ognition section 1 08. Thus, if the registration information 
adding section 110 detects that the similarity with re- 
spect to specified registration information is lowered, it 
additionally registers registration information such as a 
partial space (reference feature amount) as the feature 
amount obtained from the face image input at this time 
as new registration information into the registration in- 
formation holding section 109, 

[0066] First, the registration information adding sec- 
tion 110 detects whether the recognition rate in the rec- 
ognition section 108 is lowerthan a preset value or not. 
For example, the registration Information adding section 
110 detects that the similarity is lowed or not by deter- 
mining whether or not the degree of similarity calculated 
in the recognition section 108 is lower than a threshold 
value as a reference value used for determination of ad- 
ditional registration. Then, if the registration information 
adding section 110 determines that the degree of simi- 
larity calculated in the recognition section 108 becomes 
lower than the reference value used for determination 
of additional registration, the registration information 
adding section 110 additionally registers registration in- 
formation which contains the feature amount extracted 



by the feature amount extracting section 1 07 at this time 
as a new reference feature amount into the registration 
information holding section 1 09. 

[0067] That is, a lowering in the similarity with respect 
5 to the specified registration information is determined by 
previously setting a reference value used for determina- 
tion of additional registration of registration information 
and comparing the similarity as the recognition result 
with the reference value for determination of additional 
10 registration. Then, if the similarity as the recognition re- 
sult becomes smaller than the reference value for de- 
termination of additional registration, it is determined 
that it is necessary to add new recognition information. 
[0068] Further, the relation between the reference val- 
*5 ue (Ladd) used for determination of additional registra- 
tion and the recognition threshold value (Lrec) in the rec- 
ognition section 108 is required to satisfy the following 
expression. 



20 



Ladd > Lrec 



[0069] Thus, in a case where a plurality of registration 
information items are held as reference feature amounts 

25 of one person, the recognition section 108 can perform 
the recognition process based on a plurality of partial 
spaces corresponding to one person. The reason why 
a plurality of registration information items are held as 
the reference feature amounts of one person is that a 

30 lowering in the similarity due to a variation in the hair 
style, beard or makeup or the presence or absence of 
glasses can be suppressed, for example. That is, by 
holding a plurality of registration information items, a 
variation in the face image due to a variation in the 

35 standing position or a variation in the face itself can be 
coped with. Further, since a lowering in the similarity is 
determined based on the recognition result and new 
registration information is added, additional registration 
of registration information can be easily performed while 

40 the present apparatus is being operated. 

[0070] Next, the ten-key section 104 and number in- 
put processing section 111 are explained. 
[0071] The ten-key section 104 is operated by a per- 
son to input an ID number or the like when the person 

45 is identified based on the face image by specifying the 
person by use of the ID number (or password or the like). 
Further, the number input processing section 111 proc- 
esses the ID number input by the ten-key section 104. 
[0072] For example, as shown in FIG. 8, the ten-key 

50 section 104 is disposed on the lower right side of the 
camera 101. In the arrangement of the ten-key section 
104, the effect that a hand of the person who inputs the 
ID number by use of the ten-key section 1 04 will not ob- 
struct inputting of a face image can be attained. 
55 [0073] The arrangement position of the ten-key sec- 
tion 104 is not limited to that shown in FIG. 8. For ex- 
ample, as shown in FIG. 9. the ten-key section 104 can 
be disposed directly below the camera 101, that is. be- 
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tween the camera 101 and the second illuminating sec- 
tion 103. Further, as shown in FIG. 10, the ten-l^ey sec- 
tion 104 can be disposed below the second illuminating 
section 1 03, or as shown in FIG. 1 1 , keys of the ten-key 
section 104 can be arranged on a horizontal line below 
the second illuminating section 103. In the above cases, 
it Is possible to attain the effect that a hand of the person 
who inputs the ID number will not obstruct inputting of 
a face image as described above. 
[0074] FIGS. 1 2, 1 3, 1 4 and 1 5 each show the relation 
of the arrangement positions in a case where a display 
section 120 such as a monitor is added to each of the 
configurations shown in FIGS. 8, 9, 10 and 1 1 . As shown 
in FIGS. 12 to 15, the face image of a person who is 
being photographed by the camera 101 can be dis- 
played by arranging the display section 120 such as the 
monitor. Further, desired information can be displayed 
on the display section 120 while the recognition process 
is not being performed. 

[0075] Next, the relation between an input method by 
use of the ten-key section 104, a processing method in 
the number input processing section 1 1 1 and the recog- 
nition method of the face image is explained in detail. In 
the following explanation, a case wherein the recogni- 
tion section 1 08 recognizes the face image by use of the 
ID number of a to-be-recognized person 100 is ex- 
plained. 

[0076] For example, when the face image of a person 
is not input, the ID number input by use of the ten-key 
section 104 is made invalid in the number input process- 
ing section 111. Thus, when the face image of a person 
is not Input, the recognition section 108 is kept inoper- 
ative. Therefore, a doubtful person or a person who 
works mischief can be prevented from being incorrectly 
recognized and the effect that doubtful and mischievous 
actions can be suppressed can be attained. 
[0077] Next, the concrete process is explained with 
reference to the flowchart shown in FIG. 16. The flow- 
chart shown in FIG. 1 6 mainly indicates the flow of the 
recognition process in the recognition section 108. 
[0078] When an ID number is input by use of the ten- 
key section 1 04 (step ST21 ), the number input process- 
ing section 111 detects that the ID number is input. 
At this time, the recognition section 108 determines 
whetheror not aface image exits in the Inputimage from 
the camera 101 by performing the face image detecting 
process by the feature amount extracting section 107 or 
image input section 1 06 (step ST22). If it is determined 
in the above determination process that no face image 
exists, the recognition section 108 returns the process 
to the step ST21 and repeats the above operation. That 
is, even if the ID number is input from the ten-key section 
104 and when no input image from the camera 101 ex- 
ists, the recognition section 108 determines that the op- 
eration is a mischievous operation or erroneous opera- 
tion and makes the ID number input via the ten-key sec- 
tion 104 invalid by use of the number input processing 
section 111. 



[0079] Further, it is determined in the step ST22 that 
the face image exists, the number input processing sec- 
tion 1 1 1 deals with the number input via the ten-key sec- 
tion 1 04 as a valid ID number. Then, the recognition sec- 

5 tion 108 reads out registration information (partial 
space) corresponding to the ID number input via the ten- 
key section 104 and supplied from the number input 
processing section 111 from the registration information 
holding section 109 (step ST23). When registration \n- 

10 formation corresponding to the ID number is read out, 
the recognition section 108 calculates the similarity be- 
tween the partial space of each registration information 
item and an input vector (inherent vector of the partial 
space calculated based on the input image in the feature 

15 amount extracting section 1 07) or an input partial space 
in order to perform the recognition process by the partial 
space method (step ST24). 

[0080] Next, the recognition section 108 compares 
the similarity derived in the step ST24 with a preset 

20 threshold value (steps ST25, ST26). As the result of 
comparison, if it is determined that the similarity is larger 
than the threshold value, the recognition section 1 08 de- 
termines that the person is successfully recognized and 
outputs the recognition result (step ST27). If the similar- 

25 ity is not larger than the threshold value, the recognition 
section 108 determines that the person is not success- 
fully recognized and outputs a recognition failure (step 
ST28). 

[0081] Further, if the ID number is started to be input 
30 by use of the ten-key section 104 and when the face 
image of a person is detected, the image input section 
1 06 starts to input the face image. As a result, since time 
for inputting the face image can be reduced and time 
until the recognition result is output can be reduced, the 
35 psychological time-reducing effect on the user can be 
attained. 

[0082] Next, the process for starting to input the image 
and starting to input the ID number is explained with ref- 
erence to the flowchart shown in FIG. 17. The flowchart 

40 of FIG. 1 7 is basically the same as the flowchart shown 
in FIG. 16 except that the step ST29 Is additionally pro- 
vided in which the face image from the camera 101 
starts to be input (fetched) when it is determined in the 
step ST22 that the face image exists in the image pho- 

45 tographed by the camera 101 , that is, when the face Im- 
age is detected. The other process are the same as 
those of FIG. 16 and the detail explanation thereof is 
omitted. 

[0083] Further, in the input operation in the ten-key 

50 section 104, a method for sequentially reducing the 
number of registration information items such as ID 
numbers used as individual information each time the 
ID number is input by one digit and finally specifying the 
ID number is considered. For example, if the ID number 

55 is configured by four digits, the number of registration 
information items in the registration information holding 
section 109 is reduced to approximately 1/10 times the 
original number when a number of the first upper digit 
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is input. Further, when a number of the second upper 
digit is input, the number of registration information 
items is reduced to approximately 1/100 times the orig- 
inal number. Thus, it becomes possible to reduce time 
until the recognition result is output by sequentially re- 5 
ducing and selecting the number of registration informa- 
tion items. 

[0084] Next, a concrete process for sequentially re- 
ducing the number of registration information items 
each time the ID number is input by one digit is explained io 
with reference to the flowchart shown in FIG. 18. The 
flowchart of FIG. 1 8 mainly indicates the flow of the proc- 
ess of the recognition section 108. 
[0085] When a first digit of the ID number is input by 
use of the ten-key section 104 (step ST31), the recog- is 
nition section 108 determines whether or not a face im- 
age exits in the image photographed by the camera 101 
(step ST32). If it is determined in the above determina- 
tion process that no face image exists, the recognition 
section 108 returns the process to the step ST31 and 20 
repeats the above operation. Further, if it is determined 
in the step ST32 that the face image exists, the recog- 
nition section 108 reduces the number of registration in- 
formation items held in the registration information hold- 
ing section 1 09 based on the first upper-digit number of 25 
the ID number input by use of the ten-key section 104. 
In this case, registration information items of a corre- 
sponding ID number are searched for by using the input 
first upper-digit number as the searching condition. For 
example, in a case where numerals of 0 to 9 are uni- 30 
formly assigned as information of each digit of ail of the 
ID numbers held in the registration information holding 
section 109. the number of registration information 
items in the registration information holding section 109 
is reduced to approximately 1/10 times the original 35 
number. Further, when the second upper digit is input, 
the recognition section 108 further reduces the number 
of registration information items which has been re- 
duced to approximately 1/10 times the original number 
to approximately 1/1 00 times the original number, for ex- 4o 
ample. The recognition section 108 repeatedly performs 
the above registration information number reducing 
process until the fourth upper digit (the lowest digit) of 
the ID number is input (step ST33). 
[0086] In this case, if the fourth upper digit (the lowest 
digit) of the ID number is input (step ST34), the recog- 
nition section 1 08 determines the ID number of four dig- 
its (all digits) (step ST35). The recognition section 108 
selects and reads out registration information (partial 
space) corresponding to the thus determined ID number so 
from the reduced number of registration information 
items In the registration information holding section 109 
(step ST36). If the registration information is determined 
by determination of the ID number, the recognition sec- 
tion 108 calculates the similarity between the partial 55 
space of each registration information and an input vec- 
tor (inherent vector calculated based on the input image 
in the feature amount extracting section 1 07) or an input 



partial space in order to perform the recognition process 
by the partial space method r the like (step ST37). 
[0087] Next, the recognition section 108 compares 
the similarity derived in the step ST37 with a preset 
threshold value (steps ST38, ST39). As the result of 
comparison, if it is determined that the similarity is larger 
than the threshold value, the recognition section 1 08 de- 
termines that the person is successfully recognized and 
outputs the recognition result (step ST40). If it is deter- 
mined as the result of comparison that the similarity is 
not larger than the threshold value, the recognition sec- 
tion 108 determines that the person is not successfully 
recognized and outputs a recognition failure (step 
ST41). 

[0088] As explained above, according to the first em- 
bodiment, the effect that a hand of the person who inputs 
the password or ID number does not obstruct inputting 
of a face image can be attained by arranging the ten- 
key section on the lower right side of or directly below 
the camera as viewed from the to-be-recognized per- 
son. Further, the effect that a to -be -recognized person 
can be kept from becoming aware of the presence of 
the camera can be attained by arranging the camera in- 
side the ten-key section. 

[0089] Next, a second embodiment of this invention 
is explained. 

[0090] FIG. 1 9 schematically shows the configuration 
of a face image recognition apparatus according to the 
second embodiment The second embodiment is similar 
to the first embodiment except that the first illuminating 
section 102 and second illuminating section 103 in the 
first embodiment are omitted and the camera 101 is ar- 
ranged inside the ten-key section 104, for example, in 
the central portion of the ten-key section 104 in which 
keys are arranged in a rectangular form as shown in 
FIG. 20 in detail. The other portions are the same as 
those of the first embodiment and the explanation there- 
of is omitted. 

[0091] The reason why the first illuminating section 
102 and second illuminating section 103 are omitted is 
that the present apparatus Is installed in a location in 
which external illumination is stable. That is, if the ex- 
ternal illumination is stable, a variation in the face image 
photographed by the camera 101 is small. Therefore, 
an influence given to a process for extracting a face im- 
age from an image photographed by the camera 1 01 , a 
process for extracting the face feature amount and the 
like can be suppressed. Particularly, if the external illu- 
mination is stable, the way of forming the shade on the 
face image is stable so that the face feature amount ex- 
tracted from the image photographed by the camera 101 
can be made stable. Therefore, if the external illumina- 
tion is stable, an influence given to the recognition proc- 
ess can be suppressed even when the illuminating sec- 
tion is not provided and the apparatus can be made 
small. Of course, even if the first illuminating section 1 02 
and second illuminating section 103 are installed when 
the external illumination is stable, there occurs no influ- 



11 



21 



EP 1 280 095 A1 



22 



ence on the performance of the recognition process and 
the like. 

[0092] Further, as shown in FIG. 20, when the camera 
101 is arranged inside the ten-key section 1 04, the effect 
that a to-be-recognized person can be kept from becom- 
ing aware of the presence of the camera can be attained 
and the apparatus can be made small. 
[0093] As described above, according to the second 
embodiment, it is possible to provide a face image rec- 
ognition apparatus and passage control apparatus in 
which the face image of a to-be-recognized person can 
be acquired in a natural state without causing the to-be- 
recognized person to become aware of the presence of 
the image input section by arranging the image input 
section inside the key-input section. 
[0094] Next, a third embodiment of this invention is 
explained. 

[0095] In the third embodiment, the recognition proc- 
ess Is performed for registration Information items of a 
number which is reduced each time the ID number is 
Input by one digit. In the first embodiment, the operation 
for reducing the number of registration information items 
each time the ID number is input by one digit is ex- 
plained, but in the third embodiment, each time the ID 
number is input by one digit, the number of registration 
information items is reduced and the recognition proc- 
ess for the reduced number of registration information 
items is performed. 

[0096] The configuration of the face image recogni- 
tion apparatus to which the third embodiment is applied 
Is the same as that of the face image recognition appa- 
ratus explained in the first or second embodiment, and 
therefore, the detail explanation thereof is omitted. 
[0097] The first example of the operation in the third 
embodiment is explained below. 
[0098] FIG. 21 Is a flowchart for illustrating the first 
operation example of the third embodiment. The flow- 
chart of FIG. 21 mainly shows the flow of the process of 
a recognition section 108. In the following explanation, 
a case wherein the ID number is configured by a three- 
digit number is explained. 

[0099] When a first digit (first upper digit) of the ID 
number is input by use of the ten-key section 104 (step 
ST51 ), the recognition section 108 determines whether 
or not a face image exits in an image photographed by 
the camera 101 (step ST52). If it is determined in the 
above determination process that no face image exists, 
the recognition section 108 returns the process to the 
step ST51 and repeats the above operation. That is, 
even when the ID number is input by use of the ten-key 
section 104, the recognition section 108 regards the in- 
put operation as a mischievous operation or erroneous 
operation if no face image exits in the image photo- 
graphed by the camera 1 01 . Then, the ID number input 
by use of the ten-key section 104 is made invalid by the 
number input processing section 111. 
[0100] Further, it is determined in the step ST52 that 
the face image exists, the number input processing sec- 



tion 111 makes valid the ID number input by use of the 
ten-key section 104 and supplies the same to the Vec- 
ognition section 108. When the first digit of the ID 
number is input by use of the ten-key section 1 04, that 

5 is, when the first digit number from the upper position of 
the ID number is input, the recognition section 108 re- 
duces the number of registration information items if the 
number input processing section 111 determines that 
the input ID number is valid. More specifically, the rec- 
to ognition section 108 selects registration information 
items of all of the ID numbers each having the same 
number as the input digit number from all of the regis- 
tration information items held in the registration informa- 
tion holding section 109 and thus reduces the number 

15 of registration information items (step ST53). 

[0101] After the number of registration information 
items is reduced according to the first upper digit of the 
ID number, the recognition section 108 reads out the 
registration information items of the reduced number 

20 from the registration information holding section 109 
(step ST54). After reading out the registration informa- 
tion items of the reduced number, the recognition sec- 
tion 108 calculates the similarity between the partial 
space of each registration information and an input vec- 

25 tor (inherent vector of the partial space calculated based 
on the input image in the feature amount extracting sec- 
tion 107) or an input partial space in order to perform 
the recognition process by the partial space method or 
the like based on the readout registration information 

30 items. After all of the similarities with respect to the reg- 
istration information items of the reduced number have 
been calculated, the recognition section 108 derives the 
maximum one of the calculated similarities (maximum 
similarity) (step ST55). 

35 [0102] Next, the recognition section 108 compares 
the maximum similarity derived in the step ST55 with a 
preset threshold value (steps ST56, ST57). As the result 
of comparison, if it is determined that the maximum sim- 
ilarity is larger than the threshold value, the recognition 

40 section 108 determines that collation between the face 
image photographed by the camera 101 and the regis- 
tration information of the maximum similarity is success- 
fully made and outputs the recognition result based on 
the registration information (step ST58). 

^5 [0103] If the maximum similarity is not larger than the 
threshold value, the recognition section 108 waits until 
a next digit of the ID number is input by use of the ten- 
key section 104. In this state, if input of a determination 
key which is used to determine the ID number is not 

50 made and a next-digit number (the second digit number 
from the upper position of the ID number) is input by use 
of the ten-key section 104 (step ST59), the recognition 
section 108 further reduces the number of registration 
information items from the registration information items 

55 of the number which has been reduced in the preceding 
cycle (the registration information items of the number 
which has been reduced based on the first upper-digit 
number) based on the input second upper-digit number 
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(step ST53). 

[6l04] When the number of registration information 
items is reduced according to the second digit of the ID 
number, the recognition section 108 reads out the reg- 
istration information items of the reduced number from 
the registration information holding section 109 (step 
ST54). Then, the recognition section 108 calculates the 
similarity between the partial space of each registration 
information and an input vector (inherent vector of the 
partial space calculated based on the Input image In the 
feature amount extracting section 107) or an input par- 
tial space in order to perform the recognition process by 
the partial space method or the like. At this time, since 
the number of registration information items is further 
reduced In comparison with a case in the preceding cy- 
cle, it is possible for the recognition section 108 to cal- 
culate the similarity between the registration information 
and the input vector or input partial space by use of a 
different recognition method. Further, the recognition 
section 108 may permit the feature amount extracting 
section 107 to perform the extraction process for ex- 
tracting the inherent vector or input partial space from 
the Input image again. 

[0105] After alt of the similarities with respect to the 
registration information items of the number which is re- 
duced according to the second upper digit of the ID 
number have been calculated, the recognition section 
108 derives the maximum one of the calculated similar- 
ities (maximum similarity) (step ST55). When the max- 
imum similarity is derived, the recognition section 108 
compares the maximum similarity derived in the step 
ST55 with a preset threshold value (steps ST56, ST57). 
In this case, since the number of registration information 
items is further reduced in comparison with a case in the 
preceding cycle, the threshold value to be compared 
with the maximum similarity may be set to a value small- 
er than the threshold value used in the preceding cycle. 
[0106] As the result of comparison, if it is determined 
that the maximum similarity is larger than the threshold 
value, the recognition section 108 determines that col- 
lation between the input face image and the registration 
information of the maximum similarity is successfully 
made and outputs the recognition result based on the 
registration information (step ST58). 
[0107] Further, as the result of comparison, if it is de- 
termined that the maximum similarity is not larger than 
the threshold value, the recognition section 108 waits 
until a next number is input by use of the ten-key section 
104. In this state, if input of the determination key which 
is used to specify completion of input of the ID number 
is not made and a next-digit number (the third digit 
number from the upper position of the ID number) is in- 
put by use of the ten-key section 104 (step ST59), the 
recognition section 108 further reduces the number of 
registration information items from the registration infor- 
mation items of the number which has been reduced in 
the second cycle (the registration information items of 
the number which has been reduced based on the first 



and second upper-digit numbers) based on the input 
third upper-digit number (step ST53). 
[0108] When the number of registration information 
items is reduced according to the third digit ID number, 

5 the recognition section 1 08 reads out the registration in- 
formation items of the reduced number from the regis- 
tration information holding section 109 (step ST54) like 
the case of the preceding cycle. After reading out the 
reduced number of registration information items, the 

10 recognition section 108 calculates the similarity be- 
tween the partial space of each registration information 
and an input vector (inherent vector from the feature 
amount extracting section 1 07) or an input partial space. 
At this time, since the number of registration information 

^5 items is further reduced in comparison with a case in the 
preceding cycle, it is possible for the recognition section 
108 to calculate the similarity between the registration 
information and the Input vector or input partial space 
by use of a recognition method different from that used 
20 in the preceding cycle. Further, the recognition section 
108 may permit the feature amount extracting section 
107 to perform the extraction process for extracting the 
inherent vector or input partial space from the input im- 
age again. 

25 [0109] After all of the similarities with respect to the 
registration information items of the number which is re- 
duced according to the third upper digit of the ID number 
have been calculated, the recognition section 108 de- 
rives the maximum one of the calculated similarities 

30 (maximum similarity) (step ST55). The recognition sec- 
tion 1 08 compares the maximum similarity derived in the 
step ST55 with a preset threshold value (steps ST56, 
ST57). In this case, since the number of registration in- 
formation items is further reduced in comparison with a 

35 case in the preceding cycle, the threshold value to be 
compared with the maximum similarity may be set to a 
value smaller than the threshold value used in the pre- 
ceding cycle. 

[01 1 0] As the result of comparison, if it Is determined 

40 that the maximum similarity is larger than the threshold 
value, the recognition section 108 determines that col- 
lation between the input face Image and the registration 
information of the maximum similarity is successfully 
made and outputs the recognition result based on the 

-^5 registration information (step ST58). 

[Oil 1] Further, as the result of comparison, if it is de- 
termined that the maximum similarity is not larger than 
the threshold value, the recognition section 108 waits 
until a next number is input by use of the ten-key section 

50 104. Inthisstate, if the determination key used to specify 
completion of input of the ID number is input, the recog- 
nition section 1 08 determines that recognition results In 
failure and outputs a recognition failure. Further, when 
a cancel key which is operated to cancel the number 

55 input by use of the ten-key section 104 is input, the rec- 
ognition section 108 returns the process to the step 
ST51 and repeats the process of the steps ST51 to 
ST59. 
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[0112] In the above description, a case wherein the 
ID number is configured by three digits is explained, but 
the same effect as described above can be attained by 
performing the process of the steps ST51 to ST59 until 
alt of the numbers of the ID number are determined even 
when the ID number is conf igured by any number of dig- 
its other than three digits. 

[0113] Further, when a recognition failure is made, 
recognition data obtained from the face image at this 
time can be held in the registration information holding 
section 109 as new recognition data (registration infor- 
mation) as explained with reference to the registration 
Information adding section 110. The detail process is the 
same as explained above and therefore the explanation 
thereof Is omitted. 

[0114] As described above, according to the first op- 
eration example of the third embodiment, the number of 
registration information items is reduced based on the 
input number and the recognition process is performed 
each time one of the numbers of the ID number is input 
If the recognition process is successfully performed in 
the course of inputting the ID number, the recognition 
result is output at this time point. As a result, time until 
the recognition result is output for the registrant can be 
reduced and the psychological time-reducing effect on 
the user can be attained. 

[01 1 5] Next, a second example of the operation ac- 
cording to the third embodiment is explained. FIG. 22 is 
a flowchart for Illustrating the second operation example 
according to the third embodiment. The flowchart of FIG. 
22 mainly shows the flow of a process in the recognition 
section 108. 

[0116] The steps ST71 to ST77, ST79 shown in FIG. 
22 are the same as the steps ST51 to ST57, ST59. 
Therefore, the detail explanation for the steps ST71 to 
ST77, ST79 is omitted. 

[01 1 7] That is, if it is determined in the step ST77 that 
the maximum similarity Is larger than a threshold value, 
the recognition section 1 08 determines that collation be- 
tween the input face image and the registration informa- 
tion of the maximum similarity is successfully made. 
Based on the determination result, the recognition sec- 
tion 108 determines an ID number based on the regis- 
tration information which is successfully collated with 
the input face image. Then, the recognition section 108 
stores the ID number (recognition ID number) deter- 
mined based on the registration information which is 
successfully collated with the input face image into a 
memory (not shown) or the like. 
[0118] After the ID number determined based on the 
registration information which is successfully collated is 
held in the memory; the recognition section 108 waits 
until the to-be-recognlzed person inputs the determina- 
tion key used to specify completion of input of the ID 
number (step ST80). In this state, if the determination 
key is input, the recognition section 108 determines or 
decides the ID number (input ID number) input by the 
user (step ST81). If the ID number is thus determined 



by the user, the recognition section 108 compares the 
recognition ID number held in the memory with the input 
ID number input by the user (step ST83). 
[0119] As the result of comparison, if it is determined 

5 that the ID number (recognition ID number) obtained 
from the recognition result coincides with the ID number 
(input ID number) input by the to-be-recognized person, 
the recognition section 108 determines that recognition 
of the face image based on the ID number Is success- 

10 fully made and outputs the recognition result. Further, if 
it is determined that the recogn'rtion ID number does not 
coincide with the input ID number, the recognition sec- 
tion 108 determines that recognition of the face image 
based on the ID number results in failure and outputs a 

15 recognition failure. 

[0120] When a recognition failure is made, recogni- 
tion information containing a feature amount obtained 
from the face image at this time can be held in the reg- 
istration information holding section 109 as new recog- 

20 nition information as explained with reference to the reg- 
istration information adding section 110. The registra- 
tion process of the new recognition information is the 
same as explained above and therefore the explanation 
thereof is omitted. 

25 [0121] As described above, according to the second 
operation example of the third embodiment, the number 
of registration information items is reduced and the rec- 
ognition process is performed each time one of the num- 
bers of the ID number is input. If the recognition process 

30 is successfully performed in the course of Inputting the 
ID number, the ID number obtained based on the rec- 
ognition information (recognition Information which 
gives the maximum similarity) which is used to success- 
fully make the recognition process is held. Then, after 

35 completion of input of an ID number by the user, the in- 
put ID number is compared with the ID number obtained 
based on the recognition information which is used to 
successfully make the recognition process. If the com- 
pared ID numbers coincide with each other, the recog- 

40 nition result Is output, and if the compared ID numbers 
do not coincide with each other, a recognition failure is 
output. As a result, the security performance in the rec- 
ognition process can be enhanced. 
[01 22] As described above, according to the third em- 

45 bodiment, the number of registration information items 
is reduced and the recognition process is performed 
each time the to-be-recognized person inputs one digit 
of the ID number. Thus, when the recognition process 
is performed based on the ID number input by the to- 

50 be-recognized person, a required period from the time 
input of the ID number is started until the time the rec- 
ognition result is obtained can be substantially reduced. 
[0123] Further, if collation with specified registration 
information Is successfully made before the to-be-rec- 

55 ognized person Inputs all of the digits of the ID number, 
the specified registration information with which colla- 
tion is successfully made is stored. Then, when input of 
the ID number by the to-be-recognized person is com- 



14 



27 



EP 1 280 095 A1 



28 



pleted, whether or not the ID number input by the to-be- 
recognized person coincides with the ID number of the 
registration information obtained as the recognition re- 
sult is determined. As a result, whether recognition is 
successfully made or results in failure can be deter- 
mined simply by determining whether or not the ID num- 
bers coincide with each other when input of the ID 
number is completed. Thus, a required period from the 
time input of the ID number is completed until the time 
the final determination result is obtained can be re- 
duced. 

[0124] Next, a fourth embodiment of this invention is 
explained. 

[01 25] The fourth embodiment is an example showing 
a case wherein the face image recognition apparatus 
explained in the first embodiment is applied to a pas- 
sage control apparatus which recognizes a face image 
of a passer and controls the passage of the passer. In 
this case, as the example of the fourth embodiment, a 
case wherein the face image recognition apparatus ex- 
plained in the first embodiment is applied to the passage 
control apparatus is explained, but it is also possible to 
apply the face image recognition apparatus explained 
in the second or third embodiment to a passage control 
apparatus. 

[01 26] FIG. 23 schematically shows the passage con- 
trol apparatus according to the fourth embodiment. For 
example, the passage control apparatus performs en- 
trance/exit management with respect to an important fa- 
cility (such as a room in which much stress is put on the 
security), recognizes the face image of a visitor (passer) 
and controls the open/close state of the entrance/exit 
door of the important facility based on the recognition 
result. 

[0127] The passage control apparatus includes a 
camera 101, first illuminating section 102, second illu- 
minating section 103, ten-key section 104, processing 
section 1 05, door control section 1 1 2 as passage control 
means and image recording section 113 as image re- 
cording means. The door control section 112 controls 
the open/close state of an entrance/exit door 202 of an 
important facility (visiting destination) 201 based on the 
recognition result in a recognition section 108. The im- 
age recording section 113 is a memory which records a 
face image photographed by the camera 101. In FIG. 
23, since portions other than the door control section 
112 and image recording section 113 are the same as 
those of the face image recognition apparatus of FIG. 
1 , the same reference symbols are attached thereto and 
the explanation thereof is omitted. 
[0128] As shown in FIGS. 24, 25, for example, the ten- 
key section 104 includes numeral keys "O^to "9", deter- 
mination key and cancel key. Further, as shown in FIGS. 
26, 27, a call button 104a can be additionally provided 
on the ten-key section 104. The call button 104a is used 
to call a person who lives in the visiting destination 201 
when the recognition result of the recognition section 
108 indicates that the derived similarity is smaller than 



the threshold value in the step ST6 in FIG. 7. for exam- 
ple. FIGS. 24 and 26 show the ten-key section 104 in 
which the keys are arranged in a rectangular form, and 
FIGS. 25 and 27 show the ten-key section 104 in which 

5 the keys are linearly arranged (in a linear form). 

[0129] For example, the recognition section 108 out- 
puts a signal of "open the door" to the door control sec- 
tion 112 when it is determined in the step ST6 in FIG. 7 
that the derived similarity is larger than the threshold val- 

10 ue or It is determined In the step ST11 that the derived 
similarity is larger than the threshold value. On the other 
hand, the recognition section 108 outputs a signal of 
"close the door" to the door control section 112 when 
the derived similarity is smaller than the threshold value. 

^5 [0130] When receiving the signal of "open the door" 
from the recognition section 108, the door control sec- 
tion 1 1 2 controls and sets the entrance/exit door 202 into 
an open state so as to permit a to-be-recognized person 
(in this case, a visitor) 1 00 to pass through the door. Fur- 

20 ther, when receiving the signal of "close the door", the 
door control section 112 holds the entrance/exit door 
202 in a closed state so as to give no admittance to the 
visitor 100. 

[0131] If the recognition section 108 fails to recognize 

25 the input face image, the image recording section 113 
records the input face image. For example, a video re- 
corder, hard disk device or the tike is used as the image 
recording section 113. Thus, by recording the input face 
image, information of the visitor can be arranged and 

30 the face image of a doubtful person cian be checked. 
[01 32] Next, a case wherein the present apparatus is 
installed at the entrance of an apartment house (such 
as a mansion) or the like is explained. In this case, by 
inputting the room number as identification information 

35 of the visiting destination by use of the ten-key section 
1 04, the number of registration Information items can be 
reduced. If recognition by the recognition section 108 Is 
successfully made, the entrance/exit door 202 is un- 
locked, and if the recognition results in failure, the per- 

40 son in the object visiting destination 201 is called by use 
of the call button 104a. 

[0133] Next, the concrete process performed when 
the present apparatus is installed at the entrance of the 
apartment house (such as a mansion) or the like is ex- 

45 plained with reference to the flowchart shown in FIG. 28. 
The flowchart shown in FIG. 28 mainly shows the flow 
of a process of the recognition section 108. In this ex- 
ample, it is assumed that a plurality of registration infor- 
mation items (of all of the members of the family, for ex- 

50 ample) are held in correspondence to one room number 
in a registration information holding section 109. 
[0134] First, when a room number is input by use of 
the ten-key section 104 (step ST91 ), the face image In- 
put section 1 06 or feature amount extracting section 1 07 

55 determines whether or not a face image exists in the 
image photographed by the camera 101 (step ST92). If 
an input image (face image) does not exist, the process 
is returned to the step ST91 and the above operation is 
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repeated. If it is determined in the step ST92 that the 
face image exists, the number input processing section 
1 1 1 makes valid the number input by use of the ten-key 
section 104 and supplies the same to the recognition 
section 108. The recognition section 108 reads out a 5 
plurality of registration information items (partial spaces) 
registered in correspondence to the number (room 
number) input via the ten-key section 104 from the reg- 
istration information holding section 109 (step ST93). 
[0135] When the plurality of registration information io 
Items corresponding to the input room number are read 
out, the recognition section 108 calculates the similari- 
ties between the plurality of registration information 
items read out from the registration information holding 
section 109 and the feature amount (partial space) ex- 
tracted by the feature amount extracting section 107 
from the image photographed by the camera 101 (step 
ST94). When the similarities with respect to the plurality 
of registration Information Items are calculated, the rec- 
ognition section 108 selects the maximum one of the 20 
calculated similarities (step ST95), After determining the 
maximum similarity, the recognition section 108 com- 
pares the maximum similarity with a preset threshold 
value (steps ST96, ST97). 

[0136] As the result of comparison, If the maximum 25 
similarity is larger than the preset threshold value, the 
recognition section 108 outputs a signal of "open the 
door" to the door control section 112 (step ST98), On 
the other hand, as the result of comparison, if the max- 
imum similarity is not larger than the preset threshold 30 
value, the recognition section 108 outputs a signal of 
"close the door" to the door control section 112 (step 
ST99). 

[0137] Inherent Information, for example, a telephone 
number of a person who lives in the visiting destination 35 
201 can be input instead of the room number and the 
input inherent Information of the person can be convert- 
ed into a room number. Also, in this case, the same ef- 
fect as that obtained in the above operation example can 
be attained. 40 
[0138] Further, the entrance/exit door 202 can be 
locked or unlocked by use of a physical key 114 at the 
entrance of the mansion, for example. In this case, as 
shown in FIG. 23, it is assumed that a key receiving sec- 
tion 11 4a which receives the physical key 11 4 is provid- ^5 
ed on the entrance/exit door 202 of the present appara- 
tus and connected to the number input processing sec- 
tion 111. As shown in FIG. 29, the physical key 114 has 
a particular shape inherent to each room. 
[0139] That is, as shown in FIG. 29, normally, the so 
physical key 114 usable at the entrance of the high-class 
house or mansion has a groove portion 115 which is 
common for the respective rooms and a groove portion 
(identifying portion inherent to the visiting destination) 
116 Inherent to each room. When the physical key 114 55 
is inserted into the key receiving section 114a, the key 
receiving section 114a identifies the groove portion 116 
inherent to each room. Thus, the key receiving section 



1 1 4a or number input processing section 1 1 1 recognizes 
the room number corresponding to the physical key '1 1 4. 
Therefore, the above physical key 114 can be used in- 
stead of Input of the room number. 
[0140] The concrete process performed when the 
physical key 114 is used is explained with reference to 
the flowchart shown in FIG. 30. The flowchart of FIG. 30 
Is basically the same as the flowchart of FIG. 28 except 
the process of the step ST101 and the other process of 
the steps ST1 02 to ST1 09 of FtG. 30 is the same as that 
of the steps ST92 to ST99 of FIG. 28. In the step ST1 01 
of FIG. 30, when the physical key 114 is inserted into 
the key receiving section 1 1 4a, the key receiving section 
1 1 4a or number input processing section 1 1 1 recognizes 
the room number corresponding to the physical key 114 
according to the shape of the groove portion 1 1 6 of the 
physical key 114. Based on the recognition result, the 
key receiving section 1 14a or number input processing 
section 111 supplies the room number corresponding to 
the physical key 1 1 4 to the recognition section 1 08. The 
process performed after this is the same as that of FIG. 
28 and therefore the explanation thereof is omitted. 
[0141] Further, a card reader which copes with a card 
(recording medium) such as a radio card, IC card, mag- 
netic card or the like can be used Instead of the ten-key 
section 104 and information such as a room number re- 
corded on the recording medium can be input. Also, in 
this case, the same effect attained In the above opera- 
tion example can be realized. 

[0142] As described above, according to the fourth 
embodiment, the passage of a passer (entrance/exit of 
a visitor) can be controlled by use of the face image rec- 
ognition apparatus explained in the first, second or third 
embodiment 

[0143] Further, according to the fourth embodiment, 
information of the visitor can be neatly arranged and the 
face image of a doubtful person can be checked by re- 
cording the input face image when the Input face image 
cannot be recognized. 

[0144] It is explicitly stated that all features disclosed 
in the description and/or the claims are intended to be 
disclosed separately and independently from each other 
for the purpose of original disclosure as well as for the 
purpose of restricting the claimed invention independent 
of the compositions of the features in the embodiments 
and/or the claims. It is explicitly stated that all value 
ranges or indications of groups of entities disclose every 
possible intermediate value or intermediate entity for the 
purpose of original disclosure as well as for the purpose 
of restricting the claimed invention. 



Claims 

1. A face image recognition apparatus which recog- 
nizes a person based on a face image, character- 
ized by comprising: 
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an image input section (101) which inputs a 
face image of a to>be-recognized person (1 00), 
an illuminating section (102, 103) which applies 
light toward at least a face of the to-be-recog- 
nized person (100), 5 
a feature amount extracting section (1 07) which 
extracts a feature amount of the face of the to- 
be-recognized person (100) based on the face 
image input by said image input section (101), 
a feature amount registration section (109) in io 
which a reference feature amount is previously 
registered in correspondence to identification 
information of the to-be-recognized person 
(100). 

a key input section (1 04) which is disposed be- is 
low said image input section (101) as viewed 
from the to -be- recognized person (100) and 
permits the to-be-recognized person (100) to 
input his own identification Information, and 
a recognition section (108) which recognizes 20 
the face Image of the to-be-recognized person 
(100) by acquiring a reference feature amount 
corresponding to identification information in- 
put by use of said key Input section (1 04) from 
said feature amount registration section (109) 25 
based on the identification information and col- 
lating the thus acquired reference feature 
amount with a feature amount extracted by said 
feature amount extracting section (107). 

30 

The face image recognition apparatus according to 
claim 1 , characterized In that said key input sec- 
tion (1 04) is disposed on the lower right side of said 
image input section (1 01 ) as viewed from the to-be- 
recognized person (100). 35 

The face image recognition apparatus according to 
claim 1 , characterized In that said key input sec- 
tion (104) is disposed directly below said image in- 
put section (101) as viewed from the to-be-recog- 
nized person (100). 

The face image recognition apparatus according to 
claim 3, characterized by further comprising a dis- 
play section (1 20) which displays a face image of a 
to-be-recognized person (100) input by said image 
input section (101). 

A face image recognition apparatus which recog- 
nizes a person based on a face image, character- so 
Ized by comprising: 

a key input section ( 1 04) which permits a to-be- 
recognized person (100) to input his own iden- 
tification information, 55 
an image input section (101 ) which is disposed 
inside said key input section (104) and inputs a 
face image of a to-be- recognized person ( 1 00), 



an illuminating section (102. 103) which applies 
light toward at least a face of the to-be-recog- 
nized person (100), 

a feature amount extracting section (107) which 
extracts a feature amount of the face of the to- 
be-recognized person (100) based on the face 
image input by said Image input section (101), 
a feature amount registration section (109) in 
which a reference feature amount is previously 
registered In correspondence to identification 
information of the to-be-recognized person 
(100), and 

a recognition section (108) which recognizes 
the face image of the to-be-recognized person 
(100) by acquiring a reference feature amount 
corresponding to identification information in- 
put by use of said key input section (1 04) from 
said feature amount registration section (109) 
based on the identification information and col- 
lating the thus acquired reference feature 
amount with a feature amount extracted by said 
feature amount extracting section (107). 

6. The face image recognition apparatus according to 
one of the claims 1 and 5, characterized In that 
said illuminating section (102, 103) includes a first 
illuminating section (102) which is disposed on the 
upper right side or upper left side of said image input 
section (101 ) as viewed from the to-be- recognized 
person (100) and applies light toward at least the 
face of the to-be-recognized person (100) and a 
second illuminating section (103) which is disposed 
below said image input section (101) as viewed 
from the to-be-recognized person (1 00) and applies 
light toward at least the face of the to-be-recognized 
person (100). 

7. The face image recognition apparatus according to 
one of the claims 1 and 5, characterized in that 
said illuminating section (102, 103) is disposed on 
the upper right side or upper left side of said image 
input section (1 01 ) as viewed from the to-be-recog- 
nized person (100). 

8. The face Image recognition apparatus according to 
one of the claims 1 and 5, characterized by further 
comprising a control section (111) which prevents 
said key input section (104) from functioning when 
no face image is input by said image input section 
(101). 

9. The face Image recognition apparatus according to 
one of the claims 1 and 5, characterized In that 
said image input section (101 ) starts to input a face 
image of the to-be-recognized person (100) when 
input of identification information by said key input 
section (104) is started. 
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10. The face image recognition apparatus according to 
one of the claims 1 and 5, characterized In that 

the identification information of the to-be- recog- 
nized person (1 00) is configured by characters of n 
(plural) digits, and said recognition section (108) re- s 
peatedly performs a method for reducing the 
number of registration information items in re- 
sponse to input of the character of the nth digit when 
the n-dlgit identification Information is input by said 
key input section (104) and further reducing the io 
number of registration information items in re- 
sponse to input of the character of the (n-1)th digit 
until the character of the first digit is input and ac- 
quires a reference feature amount corresponding to 
the n-digit identification information. is 

11. A face image recognition apparatus which recog- 
nizes a person based on a face image, character- 
ized by comprising: 

20 

an image input section (101) which inputs a 
face image of a to-be-recognized person (1 00), 
afeature amount extracting section (107) which 
extracts a feature amount of a face of the to- 
be-recognized person (1 00) based on the face 25 
image input by said image input section (101), 
a feature amount registration section (109) in 
which a reference feature amount is previously 
registered in correspondence to identification 
information of the to-be- recognized person 30 
(100), 

a key input section (104) which permits the to- 
be-recognized person (100) to input his own 
identification information configured by charac- 
ters of plural digits, and ss 
a recognition section (108) which recognizes 
the face image of the to-be-recognized person 
(100) by collating the face feature amount ex- 
tracted by said feature amount extracting sec- 
tion (107) with a reference feature amount as 4o 
registration information of a number reduced 
and selected from said feature amount regis- 
tration section (109) based on identification in- 
formation of at least one digit input by use of 
said key input section (1 04) each time the iden- 45 
tification information is input by one digit by use 
of said key input section (104). 

12. The face image recognition apparatus according to 
claim 11, characterized in that said recognition 50 
section (108) holds identification information as the 
recognition result in the case where recognition is 
successfully made by use of the face image before 

all of the digits of the identification information are 
inputby said key input section (104) and determines 55 
whether or not the identification information held as 
the recognition result and the identification informa- 
tion input by the to-be-recognized person (100) co- 



incide with each other when the to-be-recognized 
person (100) inputs all of the digits of the identifica- 
tion information by use of said key input section 
(104). 

13. The face image recognition apparatus according to 
claim 11, characterized in that said recognition 
section (108) includes a searching section (ST33, 
ST53, ST73) which reduces the number of registra- 
tion information items registered in said feature 
amount registration section (109) based on identifi- 
cation information of at least one digit input by use 
of said key input section (104) each time the iden- 
tification information is input by one digit by use of 
said key input section (104), a calculating section 
(ST37, ST55, ST75) which calculates similarities 
between the registration information items of the 
number reduced by said searching section (ST33, 
ST53, ST73) and the face feature amount extracted 
by said feature amount extracting section ( 1 07) and 
derives a maximum similarity, a first determining 
section (ST40, ST58, ST84) which determines a 
recognition result based on registration information 
which gives the maximum similarity In the case 
where the maximum similarity calculated by said 
calculating section (ST37, ST55, ST75) is larger 
than a preset threshold value, and a second deter- 
mining section (ST41, ST60, STBS) which deter- 
mines that recognition by use of the face image re- 
sults in failure in the case where the to-be-recog- 
nized person ( 1 00) inputs all of the digits of the iden- 
tification information while the maximum similarity 
calculated by said calculating section (ST37, ST55, 
ST75) is kept not larger than the preset threshold 
value. 

14. The face image recognition apparatus according to 
claim 13, characterized in that said recognition 
section (108) further includes a holding section 
(ST78) which holds identification information as a 
recognition result in the case where the maximum 
similarity calculated by said calculating section 
(ST75) is larger than a preset threshold value, a de- 
termining section (ST83) which determines whether 
or not the identification information held in said hold- 
ing section (ST78) and the identification information 
input by use of said key input section ( 1 04) coincide 
with each other when all of the digits of the identifi- 
cation information are input by use of said key input 
section (104) while the identification information as 
the recognition result is held in said holding section 
(ST78), said first determining section (ST84) deter- 
mines a recognition result based on registration in- 
formation which gives the maximum similarity in the 
case where said determining section (ST83) deter- 
mines that the identification information items coin- 
cide with each other, and said second determining 
section (ST85) determines that recognition by use 
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of the face Image results in failure in the case where 
said determining section (ST83) determines that 
the Identification information items do not coincide 
with each other. 

5 

15. A passage control apparatus which recognizes a 
face image of a passer (100) and controls the pas- 
sage of the passer (100). characterized by com- 
prising: 

10 

an image input section (101) which inputs a 
face image of a passer (100), 
an illuminating section (102, 103) which applies 
light toward at least a face of the passer (100). 
a feature amount extracting section (1 07) which is 
extracts a feature amount of the face of the pas- 
ser (1 00) based on the face image input by said 
image input section (101), 
a feature amount registration section (109) in 
which a reference feature amount is previously 20 
stored in correspondence to identification infor- 
mation of the passer (100), 
a key Input section (104) which is disposed be- 
low said image input section (101) as viewed 
from the passer (100) and permits the passer 25 
(100) to Input his own identification information, 
a recognition section (108) which recognizes 
the face image of the passer ( 1 00) by acquiring 
a reference feature amount corresponding to 
identification information input by use of said so 
key input section (104) from said feature 
amount registration section (109) based on the 
identification Information and collating the thus 
acquired reference feature amount with the fea- 
ture amount extracted by said feature amount 35 
extracting section (107), and 
a passage control section (112) which controls 
the passage of the passer (100) based on the 
recognition result by said recognition section 
(108). 40 

16. The passage control apparatus according to claim 
15, characterized In that said key input section 
(1 04) is disposed on the lower right side of said im- 
age input section (1 01 ) as viewed from the passer 45 

(100) . 

17. The passage control apparatus according to claim 
15, characterized In that said key Input section 
(104) is disposed directly below said image input so 
section (101) as viewed from the passer (100). 

18. The passage control apparatus according to claim 
15, characterized by further comprising a display 
section (120) which displays the face image of the ss 
passer (100) input by said image input section 

(101) . 



19. A passage control apparatus which recognizes a 
face image of a passer (100) and controls the pas- 
sage of the passer (100), characterized by com- 
prising: 

a key input section (1 04) which permits the pas- 
ser ( 1 00) to input his own identification informa- 
tion, 

an image input section (101 ) which is disposed 
inside said key input section (104) and inputs a 
face image of a passer (100), 
an illuminating section (102, 103) which applies 
light toward at least a face of the passer (100), 
a feature amount extracting section ( 1 07) which 
extracts a feature amount of the face of the pas- 
ser (1 00) based on the face image input by said 
image input section (101), 
a feature amount registration section (109) In 
which a reference feature amount is previously 
stored in correspondence to identification infor- 
mation of the passer (100), 
a recognition section (108) which recognizes 
the face image of the passer (1 00) by acquiring 
a reference feature amount corresponding to 
identification information input by use of said 
key input section (104) from said feature 
amount registration section (1 09) based on the 
identification information and collating the thus 
acquired reference feature amount with the fea- 
ture amount extracted by said feature amount 
extracting section (107), and 
a passage control section (112) which controls 
the passage of the passer (100) based on the 
recognition result by said recognition section 
(108). 

20. The passage control apparatus according to one of 
the claims 15 and 19, characterized In that said 
illuminating section (102, 103) includes a first illu- 
minating section (102) which is disposed on the up- 
per right side or upper left side of said Image input 
section (101) as viewed from the passer (100) and 
applies light toward at least the face of the passer 
(100) and a second illuminating section (103) which 
is disposed below said image input section (101) 
and applies light toward at least the face of the pas- 
ser (100). 

21. The passage control apparatus according to one of 
the claims 15 and 19, characterized in that said 
illuminating section (102, 103) is disposed on the 
upper right side or upper left side of said image input 
section (101 ) as viewed from the passer (100). 

22. The passage control apparatus according to one of 
the claims 15 and 19, characterized by further 
comprising a control section (111) which performs 
a control operation to prevent said key input section 
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(104) from functioning when no face image is input 
by said image input section (101). 

23. The passage control apparatus according to one of 
the claims 15 and 19, characterized In that said s 
Image input section (101 ) starts to input a face im- 
age of the passer (100) when input of identification 
information by said key input section (104) is start- 
ed. 

10 

24. The passage control apparatus according to one of 
the claims 15 and 19, characterized In that identi- 
fication information of the passer (1 00) is configured 
by characters of n (plural) digits, and said recogni- 
tion section ( 1 08) repeatedly performs a method for is 
reducing the number of registration information 
items in response to input of the character of the nth 
digit when n-digit identification information is input 

by said key Input section (1 04) and further reducing 
the number of registration information items in re- 20 
sponse to input of the character of the (n-1 )th digit 
until the character of the first digit is input and ac- 
quires a reference feature amount corresponding to 
the n-digit identificatton information. 

25 

25. A passage control apparatus which recognizes a 
face image of a passer (100) and controls the pas- 
sage of the passer (100), characterized by com- 
prising: 

30 

an image input section (101) which inputs a 
face image of a passer (100), 
afeature amount extracting section (107) which 
extracts a feature amount of a face of the pas- 
ser (100) based on the face image input by said 35 
image input section (101), 
a feature amount registration section (109) in 
which a reference feature amount correspond- 
ing to identification information of each regis- 
trant is previously registered as registration in- 4o 
formation, 

a key input section (104) which permits the pas- 
ser (100) to input his own identification informa- 
tion configured by characters of plural digits, 
and 45 
a recognition section (108) which recognizes 
the face image of the passer (100) by collating 
the face feature amount extracted by said fea- 
ture amount extracting section (107) with a ref- 
erence feature amount as the registration infor- so 
mation of a number reduced and selected from 
said feature amount registration section (109) 
based on identification information of at least 
one digit input by use of said key input section 
(104) each time the identification information is 55 
input by one digit by use of said key input sec- 
tion (104). 



26. The passage control apparatus according to claim 
25, characterized In that said recognition section 
(108) holds identification information as the recog- 
nition result when recognition is successfully made 
by use of the face image before all of the digits of 
the identification information are input by said key 
Input section (104) and determines whether or not 
the identification information held as the recognition 
result and the identification information input by the 
passer (100) coincide with each other when the 
passer (100) inputs all of the digits of the identifica- 
tion information by use of said key input section 
(104). 

27. The passage control apparatus according to claim 
25, characterized In that said recognition section 
(108) includes a searching section (ST33, ST53, 
ST73) which reduces the number of registration In- 
formation items registered in said feature amount 
registration section (109) based on identification in- 
formation of at least one digit input by use of said 
key input section (104) each time the identification 
Information Is input by one digit by use of said key 
input section (104), a calculating section (ST37, 
ST55, ST75) which calculates similarities between 
the registration information items of the number re- 
duced by said searching section (ST33, ST53, 
ST73) and the face feature amount extracted by 
said feature amount extracting section (107) and 
derives a maximum one of the similarities, a first de- 
termining section (ST40, ST58, ST84) which deter- 
mines a recognition result based on registration in- 
formation which gives the maximum similarity in the 
case where the maximum similarity calculated by 
said calculating section (ST37, ST55, ST75) is larg- 
er than a preset threshold value, and a second de- 
termining section (ST41 . ST60, ST85) which deter- 
mines that recognition by use of the face image re- 
sults in failure in the case where the passer (100) 
inputs all of the digits of the identification informa- 
tion while the maximum similarity calculated by said 
calculating section (ST37, ST55, ST75) is kept not 
larger than the preset threshold value. 

28. The passage control apparatus according to claim 
27, characterized In that said recognition section 
(108) further includes a holding section (ST78) 
which holds identification information as a recogni- 
tion result in the case where the maximum similarity 
calculated by said calculating section (ST75) is larg- 
er than a preset threshold value, a determining sec- 
tion (ST83) which determines whether or not the 
identification information held in said holding sec- 
tion (ST78) and the identification information input 
by use of said key input section (104) coincide with 
each other when all of the digits of the identification 
information are input by use of said key input sec- 
tion (104) while the identification information as the 
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recognition result is held in said holding section 
(ST78). said first determining section (ST84) deter- 
mines a recognition result based on registration in- 
formation which gives the maximum similarity in the 
case where said determining section (STBS) deter- 5 
mines that the identification information items coin- 
cide with each other, and said second determining 
section (STBS) determines that recognition by use 
of the face image results in failure in the case where 
said determining section (STBS) determines that io 
the identification information items do not coincide 
with each other. 

29. A passage control apparatus which recognizes a 
face image of a visitor and controls an open/close is 
state of an entrance/exit door of a visiting destina- 
tion based on the recognition result, characterized 
by comprising: 

an image input section (101) which inputs at 20 

least a face image of a visitor, 

an illuminating section (102, ICS) which applies 

light toward at least a face of the visitor, 

a feature amount extracting section (107) which 

extracts a face feature amount of the visitor 25 

based on the face image input by said image 

input section (101), 

a feature amount registration section (109) in 
which a reference feature amount is previously 
registered in correspondence to identification 30 
information of the visiting destination, 
a key input section (104) which is disposed be- 
low said image input section (101) as viewed 
from the visitor and permits the visitor to input 
the identification information of the visiting des- 3S 
tination, 

a recognition section (108) which recognizes 
the face image of the visitor by acquiring a ref- 
erence feature amount corresponding to iden- 
tification information input by said key input 4o 
section (104) from said feature amount regis- 
tration section (1 09) based on the identification 
information and collating the thus acquired ref- 
erence feature amount with a feature amount 
extracted by said feature amount extracting 45 
section (107), and 

a door control section (112) which controls the 
open/close state of the entrance/exit door of the 
visiting destination based on the recognition re- 
sult of said recognition section (108). so 

30. The passage control apparatus according to claim 
29, characterized In that said key input section 
(104) includes a call button (104a) which is used to 
call a person who lives in a visiting destination and ss 
makes it possible to call a person who lives in an 
object visiting destination by use of said call button 
when said recognition section (108) cannot recog- 



nize the face image of the visitor. 

31. The passage control apparatus according to claim 
29, characterized by further comprising an image 
recording section (1 1 3) which records a face Image 
input by said Image input section (101 ) in the case 
where said recognition section (108) cannot recog- 
nize the face image of the visitor. 

32. The passage control apparatus according to claim 
29, characterized In that the identification informa- 
tion of the visiting destination input by said key input 
section (1 04) is a number inherent to a person who 
lives in a visiting destination. 

33. The passage control apparatus according to claim 
29, characterized In that the entrance/exit door of 
the visiting destination can be locked/unlocked by 
use of a physical key (114) which includes an iden- 
tifying portion(116) inherent to the visiting destina- 
tion and the identification Information of the visiting 
destination can be acquired by recognizing the 
identifying portion (116). 

34. A face image recognition method used in a face im- 
age recognition apparatus including a feature 
amount registration section (109) in which identifi- 
cation information configured by characters of plu- 
ral digits assigned to at least one registrant and a 
reference feature amount of at least one registrant 
corresponding to the identification information are 
previously registered as registration Information, 
characterized by comprising: 

inputting a face image of a to-be-recognized 
person (100), 

extracting a face feature amount of the to-be- 
recognized person (100) based on the input 
face image, 

permitting the to-be-recognized person (1 00) to 
input his own identification information config- 
ured by characters of plural digits for each digit 
by use of an operation key (104), and 
recognizing the face image of the to-be-recog- 
nized person (100) by collating the face feature 
amount extracted based on the input face im- 
age with a reference feature amount as regis- 
tration information of a number reduced and se- 
lected from the feature amount registration sec- 
tion (109) based on identification information of 
at least one digit input each time the identifica- 
tion information is input by one digit by use of 
the operation key (104). 

35. The A passage control method according to claim 
34, characterized In that said recognizing the face 
image of the to-be-recognized person (100) in- 
cludes holding identification informatibn as a recog- 
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nition result in the case where recognition by use of 
the face image is successfully made before all of 
the digits of the identification information are input 
by use of the operation key (104), and determining 
whether or not the identification information held as 5 
the recognition result and the identification informa- 
tion input by the to-be-recognized person (100) co- 
incide with each other when the to-be-recognized 
person (100) inputs alt of the digits of the identifica- 
tion Information by use of the operation key (104). io 

36. A passage control method used in a passage con- 
trol apparatus including a feature amount registra- 
tion section (109) in which identification information 
configured by characters of plural digits assigned to 
at least one person who is permitted to pass through 
and a reference feature amount of at least one per- 
son corresponding to the Identification Information 
are previously registered as registration informa- 
tion, characterized by comprising: 20 

inputting a face image of a passer (100), 
extracting a face feature amount of the passer 
(100) based on the input face image, 
permitting the passer (100) to input his own 25 
identification information configured by charac- 
ters of plural digits for each digit by use of an 
operation key (104), 

recognizing the face image of the passer (100) 
by collating the face feature amount extracted 30 
based on the input face Image with a reference 
feature amount as registration Information of a 
number reduced and selected from the feature 
amount registration section (109) based on 
identification information of at least one digit in- 35 
put by use of the operation key each time the 
identification information is input by one digit by 
use of the operation key (104), and 
controlling the passage of the passer (100) 
based on the recognition result obtained by 
said recognizing the face image of the passer 
(100). 

37. The passage control method according to 

claim 36, characterized in that said recognizing 
the face image of the passer (1 00) includes holding 
identification information as a recognition result 
when recognition by use of the face image is suc- 
cessfully made before all of the digits of the identi- 
fication information are input by use of the operation so 
key (104), and determining whether or not the iden- 
tification information held as the recognition result 
and the identification information input by the pas- 
ser (1 00) coincide with each other when the passer 
(100) inputs all of the digits of the identification in- ss 
formation by use of the operation key (104). 
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